Response to office action of 9/22/06 for appl. 10/780,500 



Remarks 

Claims 1-3, 5-28 and 32-37 are pending in this application. Claims 1-3, 
5-10 and 32-35 stand rejected under 35 U.S.C. 103(a) as being unpatentable 
over Szeliski et al., U.S. patent no. 6,157,747 in view of Luken, U.S. patent no. 
5,923,334. Claims 13-21 and 37 stand rejected under 35 U.S.C. 103(a) as 
being unpatentable over Szeliski et al. U.S. patent no. 6,157,747 in view of 
Blank, U.S. patent no. 5,469,536. Claims 11-12, 22-28 and 36 stand rejected 
under 35 U.S.C. 102(b) as being anticipated by Szeliski et al., U.S. patent no. 
6,157,747. 

The rejections for anticipation by Szeliski '747 or for obviousness over 
Szeliski '747 in view of Luken '334 or Blank '536 must fail because neither 
Szeliski nor Luken nor Blake teaches, discloses or suggests a required claim 
limitation that is common to the pending claims. That is, neither Szeliski nor 
Luken nor Blake teaches, discloses or suggests creating a 3D model of a scene 
comprising geometry information describing one or more objects or features 
contained in the scene. Details are provided below. 

Claim Rejections - 35 U.S.C § 103(a) 
The rejection of Claims 1-3, 5-10 and 32-35 under 35 U.S.C. 103(a) as 
being unpatentable over Szeliski et al., U.S. patent no. 6,157,747 in view of 
Luken, U.S. patent no. 5,923,334 lacks a prima facie case. 
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Szeliski '747 discloses a method for aligning a plurality of images to 
construct a mosaic image. (See, Szeliski, abstract). Once the images are 
aligned and pieced together into a mosaic, the image can be viewed. (See, 
Szeliski, col. 5, lines 7-23). Szeliski teaches that this viewing can be performed 
using standard 3D rendering hardware with the mosaic image mapped onto a 
geometric construct, such as a polyhedron surrounding the origin. (See, 
Szeliski, col. 5, lines 24-27.) However, Szeliski does not teach, disclose or 
suggest creating a 3-D model of a scene where the 3D model of the scene 
contains geometry information about any object in the scene. Szeliski's 
mosaiced image is constructed from a series of images that have been aligned. 
(See, Szeliski, col. 4, lines 8-30). While features in the images are used to help 
align the images prior to constructing the mosaiced image, Szeliski's method 
does not identify features or objects in the mosaiced image - this image 
consists merely of a collection of pixels without features or objects identified. 
This collection of pixels can be viewed, when the mosaiced image is mapped 
onto a geometric construct, but Szeliski's method does not identify objects or 
features within this mapped image (See, e.g., col. 5, lines 7-35). Because 
Szeliski's method does not identify objects or features in the mosaiced image, 
geometry information about these as yet unidentified objects cannot be 
attached to any data structure that the method creates. 

Claim 1 requires in part: 

"...creating a three dimensional model of the visual scene from the 
transformed image panoramas using the reference coordinate system and 
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comprising geometry information describing the one or more objects contained 
in the scene." 

Because the output of Szeliski's method does not contain geometry 
information about any objects contained in the mosaiced scene, Szeliski's 
method does not teach the cited limitation of Claim 1 . 

Similarly, Luken '334 generates an environment map from an image 
representing a panoramic scene. A view of the environment map is then 
generated. (See, Luken '334, abstract; col. 3, lines 10-55.) Luken '334, like 
Szeliski '747, does not teach, disclose or suggest creating a 3-D model of a 
scene where the model contains geometry information about any object or 
feature in the scene. Luken's method's output is wholly pixel based - an 
environment map - and does not identify any object or feature within the 
scene. 

Because the output of Luken's method does not contain geometry 
information about any objects or features contained in the scene, Luken's 
method does not teach the above-cited limitation of Claim 1 . 

To establish prima facie obviousness of a claimed invention, all the claim 
limitations must be taught or suggested by the prior art. (See, e.g., MPEP 
2143.03). Because the above-cited limitation of Claim 1 is not taught by either 
Szeliski '747 or by Luken '334, a prima facie case of obviousness has not been 
made for Claim 1 . Thus, Claim 1 is deemed non-obvious over any combination 
of these two references. Claims 2-3 and 5-10 depend from Claim 1 and add 
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further limitations. These claims are deemed non-obvious over Szeliski '747 
and Luken '334 for at least the same reasons as for Claim 1 . 

Claim 32, as amended, is deemed non-obvious over Szeliski '747 in view 
of Luken '334 because claim 32 now contains a claim limitation analogous to 
the claim limitation cited above for Claim 1. Claims 33-35, which depend from 
Claim 32 and add further limitations, are deemed non-obvious over Szeliski 
'747 in view of Luken '334 for at least the same reasons as for Claim 32. 

The rejection of Claims 13-21 and 37 under 35 U.S.C. 103(a) as being 
unpatentable over Szeliski et al. U.S. patent no. 6,157,747 in view of Blank, 
U.S. patent no. 5,469,536 lacks a prima facie case. 

The rejections of Claims 13-21 and 37 for obviousness rely on Szeliski 
'747 for teaching the limitations of Claims 1 1 and 36 from which these claim 
depend, respectively. As shown below, Szeliski does not teach required 
limitations of Claims 1 1 and 36. Further, Blank '536 does not provide the 
teachings, lacking in Szeliski '747, which are cited below for Claims 1 1 and 36, 
respectively. Because Claims 13-21 and 37 depend from Claims 1 1 and 36, 
respectively, and add further limitations, Claims 13-21 and 37 are deemed 
non-obvious over Szeliski '747 in view of Blank '536. 

Claim Rejections - 35 U.S.C § 102(b) 
Claims 11, 12, 22-28 and 36 stand rejected under 35 U.S.C. §1 02(b) as 
being anticipated by Szeliski et al. U.S. patent no. 6,157,747. 
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Claim 1 1 requires in part: 

"...creating a three dimensional model of the visual scene using features 
of the visual scene and the point source; receiving an edit to one or more of the 
objects in the panorama; transforming the edit relative to a viewpoint defined 
by the point source; and projecting the transformed edit onto the objects." 

As shown above with respect to a similar limitation in Claim 1 , Szeliski 
'747 does not teach, disclose or suggest creating a 3-D model of a scene where 
the model contains geometry information about any object in the scene. 
Szeliski's mosaiced image is a collection of pixels. This collection of pixels can 
be viewed, but no objects within this collection of pixels in the mosaiced image 
are identified by Szeliski's method, either before or after the mosaiced image is 
mapped onto a geometric construct. Because objects are not identified in 
Szeliski's method after the mosaiced image is created, an edit is not received 
relative to one or more objects in the scene and a transformed edit is not 
projected onto the objects. Because Szeliski '747 does not teach these required 
limitations of Claim 11, Szeliski '747 cannot anticipate Claim 11. Claim 12 
which depends from Claim 1 1 and adds further limitations is deemed not 
anticipated by Szeliski '747 for at least the same reasons as for Claim 1 1 . 

Claim 22 requires: 

"A method for projecting texture information onto a geometric feature 
within an image panorama , the method comprising: receiving instructions from 
a user identifying a three-dimensional geometric surface within an image 
panorama, the image panorama containing features having one or more 
textures; determining a directional vector from the three-dimensional geometric 
surface; creating a geometric model of the image panorama based at least in 
part on the three-dimensional geometric surface and the directional vector; and 
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applying the one or more textures to the features in the image panorama based 
on the geometric model " (emphasis added.) 

As shown above with respect to a similar limitation in Claim 1 , Szeliski 
'747 does not teach, disclose or suggest creating a 3-D model of a scene where 
the model includes geometry information about any geometric feature or object 
in the scene. Szeliski's mosaiced image is merely a collection of pixels. This 
collection of pixels can be viewed, but no features within this collection of 
pixels are identified by Szeliski's method, after the mosaiced image is mapped 
onto a geometric construct. The Office Action (page 10, second paragraph) 
cites Szeliski '747, col. 9, lines 29-31, col. 32, lines 22-29 and lines 41-43 as 
teaching the step of "applying the one or more textures to the features in the 
image panorama based on the geometric model" as emphasized above in Claim 
22." Applicants respectfully disagree that these passages teach this step, 
because Szeliski's method does not include identifying features within the 
mosaiced image after the mosaiced image is constructed. The Examiner is 
requested to identify where this step is taught in the cited passages in the next 
office action, or, alternatively, withdraw this rejection. 

Because features are not identified in Szeliski's method in the mosaiced 
image, Szeliski '747 cannot teach at least the step of Claim 22 emphasized 
above of "applying the one or more textures to the features in the image 
panorama based on the geometric model." Because Szeliski '747 does not 
teach a required limitation of Claim 22, Szeliski '747 cannot anticipate Claim 
22. Claims 23-28 which depend from Claim 22 and adds further limitations 
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are deemed not anticipated by Szeliski '747 for at least the same reasons as for 
Claim 22. 

Claim 36 contains limitations analogous to the limitations of Claim 22. 
Claim 36 is deemed not anticipated by Szeliski '747 for at least the reasons 
cited for Claim 22. 

Double Patenting^ 

Claim 4 has been cancelled. Thus, a duplicate of Claim 3 does not exist 
within the claim set. 
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Applicant request reconsideration of all pending claims and a notice of 
allowance. The Examiner is requested to telephone the undersigned if any 
matters remain outstanding so that they may be resolved expeditiously. The 
Commissioner is hereby authorized to charge any deficiency in the fees filed, 
asserted to be filed or which should have been filed herewith to our Deposit 
Account No. 19-4972. 



Respectfully submitted, 



/John L. Conway, #48,241/ 



Bromberg & Sunstein LLP 
125 Summer Street 
Boston, MA 02110-1618 
(617) 443-9292 



John L. Conway 
Registration No. 48,241 
Attorney for Applicants 



02894/00108 552915.2 



Page 16 of 16 



